Nonlinear Partial Least Squares: An Overview
نویسنده
چکیده
In many areas of research and industrial situations, including many data analytic problems in chemistry, a strong nonlinear relation between different sets of data may exist. While linear models may be a good simple approximation to these problems, when nonlinearity is severe they often perform unacceptably. The nonlinear partial least squares (PLS) method was developed in the area of chemical data analysis. A specific feature of PLS is that relations between sets of observed variables are modeled by means of latent variables usually not directly observed and measured. Since its introduction, two methodologically different concepts of fitting existing nonlinear relationships initiated development of a series of different nonlinear PLS models. General principles of the two concepts and representative models are reviewed in this chapter. The aim of the chapter is two-fold i) to clearly summarize achieved results and thus ii) to motivate development of new computationally efficient nonlinear PLS models with better performance and good interpretability.
منابع مشابه
Least Squares Methods for Models Including Ordinary and Partial Differential Equations
This contribution gives a brief overview on nonlinear constrained least squares methods. The focus is on data fitting problems in which the models include ordinary or partial differential equations.
متن کاملMultilinear and nonlinear generalizations of partial least squares: an overview of recent advances
Partial Least Squares (PLS) is an efficient multivariate statistical regression technique that has proven to be particularly useful for analysis of highly collinear data. To predict response variables Y from independent variables X, PLS attempts to find a set of common orthogonal latent variables by projecting both X and Y onto a new subspace respectively. As an increasing interest in multiway ...
متن کاملSuperlinearly convergent exact penalty projected structured Hessian updating schemes for constrained nonlinear least squares: asymptotic analysis
We present a structured algorithm for solving constrained nonlinear least squares problems, and establish its local two-step Q-superlinear convergence. The approach is based on an adaptive structured scheme due to Mahdavi-Amiri and Bartels of the exact penalty method of Coleman and Conn for nonlinearly constrained optimization problems. The structured adaptation also makes use of the ideas of N...
متن کاملAn Overview on the Shrinkage Properties of Partial Least Squares Regression
The aim of this paper is twofold. In the rst part, we recapitulate the main results regarding the shrinkage properties of Partial Least Squares (PLS) regression. In particular, we give an alternative proof of the shape of the PLS shrinkage factors. It is well known that some of the factors are > 1. We discuss in detail the e ect of shrinkage factors for the Mean Squared Error of linear estimato...
متن کاملModel Design and Data Analysis for Multi-Input Multi-Output Systems
The design of multivariable control systems requires identification of the effects of individual inputs on each of the outputs. In many complex systems whose behavior is described by a large set of partial differential equations, the solution cannot be implemented in real time. This paper presents an overview of several linear and nonlinear approximators – least squares, principle component reg...
متن کامل